The lab management practices of “Research Exemplars” that foster research rigor and regulatory compliance: A qualitative study of successful principal investigators

IntroductionConducting rigorous scientific inquiry within the bounds of research regulation and acceptable practice requires a principal investigator to lead and manage research processes and personnel. This study explores the practices used by investigators nominated as exemplars of research excellence and integrity to produce rigorous, reproducible research and comply with research regulations.MethodsUsing a qualitative research design, we interviewed 52 principal investigators working in the United States at top research universities and the National Institutes of Health Intramural Research Program. We solicited nominations of researchers meeting two criteria: (1) they are federally-funded researchers doing high-quality, high-impact research, and (2) have reputations for professionalism and integrity. Each investigator received an initial nomination addressing both criteria and at least one additional endorsement corroborating criteria 2. A panel of researchers and our research team reviewed the nominations to select finalists who were invited to participate. The cohort of "Research Exemplars" includes highly accomplished researchers in diverse scientific disciplines. The semi-structured interview questions asked them to describe the routine practices they employ to foster rigor and regulatory compliance. We used inductive thematic analysis to identify common practices.ResultsThe exemplars identified a core set of 8 practices and provided strategies for employing them. The practices included holding regular team meetings, encouraging shared ownership, providing supervision, ensuring adequate training, fostering positive attitudes about compliance, scrutinizing data and findings, and following standard operating procedures. Above all, the use of these practices aim to create a psychologically safe work environment in which lab members openly collaborate to scrutinize their work and share in accountability for rigorous, compliant research.ConclusionsResearchers typically receive limited systematic training in how to lead and manage their research teams. Training and education for principal investigators should include essential leadership and management practices and strategies that support doing high-quality research with integrity

LEADER COGNITION DURING ORGANIZATIONAL CRISIS: AN EXPERIMENTAL INVESTIGATION OF OUTCOME FRAMING AND STRATEGIC ORIENTATION EFFECTS

Leadership is traditionally understood as a social influence process, but leaders also have to think. This study, using a simulated leadership task, exposed participants to a complex, ambiguous organizational crisis and required them to generate a problem solution and vision. A negative or positive outcome frame and a prevention or promotion strategic orientation were manipulated, along with attribution of responsibility. A balanced orientation to the problem, either a negative outcome frame accompanied by a promotion strategy or a positive outcome frame accompanied by a prevention strategy, produced solutions and visions of highest quality. Attribution of responsibility influenced the originality of solutions. The findings with regard to the effectiveness of a balanced orientation call into question the emphasis of many current leadership theories on positivity. It appears that some negativity is required, suggesting that effective leaders must be able to effectively shift between positivity and negativity

Professional decision-making in medicine: Development of a new measure and preliminary evidence of validity

INTRODUCTION: This study developed a new Professional Decision-Making in Medicine Measure that assesses the use of effective decision-making strategies: seek help, manage emotions, recognize consequences and rules, and test assumptions and motives. The aim was to develop a content valid measure and obtain initial evidence for construct validity so that the measure could be used in future research or educational assessment. METHODS: Clinical scenario-based items were developed based on a review of the literature and interviews with physicians. For each item, respondents are tasked with selecting two responses (out of six plausible options) that they would choose in that situation. Three of the six options reflect a decision-making strategy; these responses are scored as correct. Data were collected from a sample of 318 fourth-year medical students in the United States. They completed a 16-item version of the measure (Form A) and measures of social desirability, moral disengagement, and professionalism attitudes. Professionalism ratings from clerkships were also obtained. A sub-group (n = 63) completed a second 16-item measure (Form B) to pilot test the instrument, as two test forms are useful for pre-posttest designs. RESULTS: Scores on the new measure indicated that, on average, participants answered 75% of items correctly. Evidence for construct validity included the lack of correlation between scores on the measure and socially desirable responding, negative correlation with moral disengagement, and modest to low correlations with professionalism attitudes. A positive correlation was observed with a clerkship rating focused on professionalism in peer interactions. CONCLUSIONS: These findings demonstrate modest proficiency in the use of decision-making strategies among fourth-year medical students. Additional research using the Professional Decision-Making Measure should explore scores among physicians in various career stages, and the causes and correlates of scores. Educators could utilize the measure to assess courses that teach decision-making strategies

Assessing clinical research coordinator knowledge of good clinical practice: An evaluation of the state of the art and a test validation study

This paper describes the development and validation of a new 32-item test of knowledge of good clinical practice (GCP) administered to 625 clinical research coordinators. GCP training is mandated by study sponsors including the US National Institutes of Health. The effectiveness of training is rarely assessed, and the lack of validated tests is an obstacle to assessment. The GCP knowledge test was developed following evaluation of two existing widely used GCP tests to ensure it accurately reflects the content of current training. The final GCP knowledge test demonstrated good reliability

Enabling hotspot detection and public health response to the COVID-19 pandemic

INTRODUCTION: Public-facing maps of COVID-19 cases, hospital admissions, and deaths are commonly displayed at the state, county, and zip code levels, and low case counts are suppressed to protect confidentiality. Public health authorities are tasked with case identification, contact tracing, and canvasing for educational purposes during a pandemic. Given limited resources, authorities would benefit from the ability to tailor their efforts to a particular neighborhood or congregate living facility. METHODS: We describe the methods of building a real-time visualization of patients with COVID-19-positive tests, which facilitates timely public health response to the pandemic. We developed an interactive street-level visualization that shows new cases developing over time and resolving after 14 days of infection. Our source data included patient demographics (ie, age, race and ethnicity, and sex), street address of residence, respiratory test results, and date of test. RESULTS: We used colored dots to represent infections. The resulting animation shows where new cases developed in the region and how patterns changed over the course of the pandemic. Users can enlarge specific areas of the map and see street-level detail on residential location of each case and can select from demographic overlays and contour mapping options to see high-level patterns and associations with demographics and chronic disease prevalence as they emerge. CONCLUSIONS: Before the development of this tool, local public health departments in our region did not have a means to map cases of disease to the street level and gain real-time insights into the underlying population where hotspots had developed. For privacy reasons, this tool is password-protected and not available to the public. We expect this tool to prove useful to public health departments as they navigate not only COVID-19 pandemic outcomes but also other public health threats, including chronic diseases and communicable disease outbreaks

Exploring perceptions of healthcare technologies enabled by artificial intelligence: An online, scenario-based survey

BACKGROUND: Healthcare is expected to increasingly integrate technologies enabled by artificial intelligence (AI) into patient care. Understanding perceptions of these tools is essential to successful development and adoption. This exploratory study gauged participants\u27 level of openness, concern, and perceived benefit associated with AI-driven healthcare technologies. We also explored socio-demographic, health-related, and psychosocial correlates of these perceptions. METHODS: We developed a measure depicting six AI-driven technologies that either diagnose, predict, or suggest treatment. We administered the measure via an online survey to adults (N = 936) in the United States using MTurk, a crowdsourcing platform. Participants indicated their level of openness to using the AI technology in the healthcare scenario. Items reflecting potential concerns and benefits associated with each technology accompanied the scenarios. Participants rated the extent that the statements of concerns and benefits influenced their perception of favorability toward the technology. Participants completed measures of socio-demographics, health variables, and psychosocial variables such as trust in the healthcare system and trust in technology. Exploratory and confirmatory factor analyses of the concern and benefit items identified two factors representing overall level of concern and perceived benefit. Descriptive analyses examined levels of openness, concern, and perceived benefit. Correlational analyses explored associations of socio-demographic, health, and psychosocial variables with openness, concern, and benefit scores while multivariable regression models examined these relationships concurrently. RESULTS: Participants were moderately open to AI-driven healthcare technologies (M = 3.1/5.0 ± 0.9), but there was variation depending on the type of application, and the statements of concerns and benefits swayed views. Trust in the healthcare system and trust in technology were the strongest, most consistent correlates of openness, concern, and perceived benefit. Most other socio-demographic, health-related, and psychosocial variables were less strongly, or not, associated, but multivariable models indicated some personality characteristics (e.g., conscientiousness and agreeableness) and socio-demographics (e.g., full-time employment, age, sex, and race) were modestly related to perceptions. CONCLUSIONS: Participants\u27 openness appears tenuous, suggesting early promotion strategies and experiences with novel AI technologies may strongly influence views, especially if implementation of AI technologies increases or undermines trust. The exploratory nature of these findings warrants additional research

Criticism and outstanding leadership : an evaluation of leader reactions and critical outcomes

Outstanding political leaders are frequently called upon to make high-stakes decisions. Because of the controversial and highly visible nature of these issues, they often face intense criticism. Leaders' responses to criticisms not only affect follower reactions, but also the successful resolution of the contested issue. The present study examines leader and follower reactions to different types of criticisms. A historiometric approach was used to examine biographies containing criticisms of 120 world leaders and to explore leader behaviors in response to criticisms. Specifically, leader response strategies and their success in terms of follower reactions and resolution of the criticism were examined. The results indicated that collaborative or confrontational leader response strategies proved most effective in terms of the leader's ability to continue forward with a particular agenda item and to gather support of those around him or her. Conversely, avoidant, diverting attention, and persuasive response strategies proved less effective

Engaging adolescents in using online patient portals

IMPORTANCE: Many health care systems offer adolescents access to health information through online patient portals, but few studies have explored how to engage adolescents in using and benefiting from online portals. OBJECTIVE: To determine how US children\u27s hospitals have attempted to encourage adolescent portal use, barriers to engaging adolescents, and ideal future goals for engagement. DESIGN, SETTING, AND PARTICIPANTS: This qualitative study performed structured qualitative interviews with informatics administrators from children\u27s hospitals across the US between February and July 2022. Informatics administrators were employed by US health care systems that managed a children\u27s hospital with at least 50 dedicated pediatrics beds. Data analysis was performed from November 2022 to January 2023. MAIN OUTCOMES AND MEASURES: This study used thematic analysis of (1) current steps that health care systems had taken to engage adolescents in using their online patient portals and (2) barriers to engaging adolescents and ideal future goals and outcomes of engagement. RESULTS: Among 58 total interviews with 65 informatics administrators who represented 63 hospitals across 58 health care systems, 6 themes of approaches to engaging adolescents in portal use were identified: (1) promoting and educating adolescents about portal enrollment, (2) establishing workflows to support enrollment, (3) seeking and incorporating feedback, (4) creating a culture or environment supporting engagement, (5) increasing portal utility, and (6) limited efforts. Barriers to engaging adolescents in portal use related to either (1) stakeholder investment, interest, and capabilities or (2) intersecting technical, ethical, and legal factors. Participants identified 4 ideal future efforts to engage adolescents: (1) develop adaptable private means of communication with adolescents, (2) use adolescent-centric user design, (3) enhance promotion and education about portal use, and (4) simplify and adapt workflows to encourage enrollment. Participants described 3 ideal outcomes of this future engagement: (1) provide education about current health, (2) prepare for transition to adulthood, and (3) improve digital health education of adolescents. CONCLUSIONS AND RELEVANCE: In this qualitative study of informatics administrators, children\u27s hospitals across the US were found to have varying degrees of efforts to engage adolescents in using their portals. Most of these efforts focused on supporting adolescent enrollment, but fewer efforts focused on making the portal useful and interesting to adolescents

Professional Decision-Making in Research (PDR): The validity of a new measure

In this paper, we report on the development and validity of the Professional Decision-Making in Research (PDR) measure, a vignette-based test that examines decision-making strategies used by investigators when confronted with challenging situations in the context of empirical research. The PDR was administered online with a battery of validity measures to a group of NIH-funded researchers and research trainees who were diverse in terms of age, years of experience, types of research, and race. The PDR demonstrated adequate reliability (alpha = .84) and parallel form correlation (r = .70). As hypothesized, the PDR was significantly negatively correlated with narcissism, cynicism, moral disengagement, and compliance disengagement; it was not correlated with socially desirable responding. In regression analysis, the strongest predictors of higher PDR scores were low compliance disengagement, speaking English as a native language, conducting clinical research with human subjects, and low levels of narcissism. Given that the PDR was written at an eighth grade reading level to be suitable for use with English as a second language participants and that only one-fourth of items focused on clinical research, further research into the possible roles of culture and research ethics training across specialties is warranted. This initial validity study demonstrates the potential usefulness of the PDR as an educational outcome assessment measure and a research instrument for studies on professionalism and integrity in research